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Question 5 


Intent of Question 


The primary goals of this question are to evaluate a student’s ability to: (1) identify the treatments in a biological 
experiment; (2) present a completely randomized design to address the research question of interest; (3) describe 
the benefit of limiting sources of variability; and (4) describe the limitations to the scope of inference for the 
biologist. 


Solution 
Part (a): 


The three different growth-enhancing nutrients (A, B, and C) and two different salinity levels (low and high) 
yield a total of 3X2 = 6 different treatment combinations for this experiment. 


























Treatment Nutrient Salinity 
Combination Level 
1 A Low 
2 A High 
3 B Low 
4 B High 
5 C Low 
6 C High 














Part (b): 


Since 10 tiger shrimps have already been randomly placed into each of 12 similar tanks in a controlled 
environment, we must randomly assign the treatment combinations to the tanks. Each treatment combination 
will be randomly assigned to 2 of the 12 tanks. One way to do this is to generate a random number for each 
tank. The treatment combinations are then assigned by sorting the random numbers from smallest to largest. 























Treatment Nutrient Salinity Tanks with 
Combination Level 

1 A Low Smallest and second smallest random 
numbers 

2 A High Third and fourth smallest random 
numbers 

3 B Low Fifth and sixth smallest random 
numbers 

4 B High Seventh and eighth smallest random 
numbers 

5 Cc Low Ninth and tenth smallest random 
numbers 

6 C High Next to largest and largest random 
numbers 
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Question 5 (continued) 


After three weeks the weight gain (after — before) is computed for each tank, and the treatments are compared 
using appropriate averages. 


Part (c): 


Using only tiger shrimp will reduce a source of variation in the experimental units, the tanks of shrimp in this 
experiment. By eliminating this possible source of variation, type of shrimp, we are better able to isolate the 
variability due to the factors of interest to us (nutrient and salinity level). This will make it easier to identify 
any treatment effects that may be present. 


Part (d): 


Using only tiger shrimp will limit the scope of inference for the biologist. Ideally, the biologist would like to 
identify the treatment combination that leads to the most growth for all shrimp. However, the biologist will 
only be able to identify the best treatment combination for tiger shrimp because other types of shrimp may 
respond differently to the treatments. 


Scoring 


Part (a) is scored as essentially correct (E) or incorrect (I). Parts (b), (c), and (d) are scored as essentially correct 
(E), partially correct (P), or incorrect (1). 


Part (a) is essentially correct (E) if all six treatments are correctly listed. This may be done in a 2 x 3 table or 
tree diagram but must clearly indicate the six treatments. A correct but incomplete listing of treatments in part (a) 
can be recovered in part (b) if the six treatments are clearly stated. 


Listing the factors (nutrients A, B, C and salinity high, low) is incorrect and cannot be recovered in part (b). 


Part (b) is essentially correct (E) if: 
e each treatment combination is randomly assigned to 2 of the 12 tanks 
AND 
e acorrect procedure for randomization is described (so that two knowledgeable statistics users would use 
the same method to assign treatments to the tanks). 


Part (b) is partially correct (P) if only one of these components is present. For example, 
e Each treatment is randomly assigned to 2 of the 12 tanks, but the method of randomization is not fully 
described (i.e., just say randomly assign each treatment to 2 of the 12 tanks). 
OR 
e Acorrect procedure for randomization of the treatments to the tanks is described, but each treatment does 
not necessarily appear twice. 


Part (b) is incorrect (1) if there is no randomization or randomization of treatments is applied to the shrimps only 
(not the tanks). 
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Question 5 (continued) 


Notes: 
e If the randomization has been correctly applied to the tanks, additionally randomizing the shrimps or 
treatments will be regarded as extraneous. 
e Because the stem indicates shrimp growth is to be compared, students are not required to identify a 
response variable in part (b) as was done in the model solution. 


Part (c) is essentially correct (E) if 
e the statistical advantage of reduced variability is identified 
AND 
e an appropriate explanation that relates reduced variability to increasing the likelihood of determining 
differences among treatments is clearly provided. 


Part (c) is partially correct (P) if only one of the two components is correct. 
Part (c) is incorrect (I) if neither of the two components is present. 
Notes: 

e Inthis completely randomized design, confounding is not possible. Therefore a reference to confounding 

or lurking variables always incurs a penalty. 

Part (d) is essentially correct (E) if 

e the statistical disadvantage of limited scope of inference is identified 

AND 


e an explanation that different species of shrimp may respond differently to treatments is provided. 


(If the different responses to the treatments by other species of shrimp have been established in part (c), then 
it need not be repeated in part (d).) 


Part (d) is partially correct (P) if only one of the two parts of the essentially correct response is provided. 


Part (d) is incorrect (1) if neither of the two parts of the essentially correct response is provided, 


4 Complete Response 
3 Substantial Response 
2 Developing Response 
1 Minimal Response 


If a response is between two scores (for example, 2! points) use a holistic approach to determine whether 
to score up or down depending on the strength of the response and communication. The strength of the 
responses in parts (b) and (c) may be most important in making this choice. 
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5. A biologist is interested in studying the effect of growth-enhancing nutrients and different salinity (salt) levels in 
water on the growth of shrimps. The biologist has ordered a large shipment of young tiger shrimps from a supply 
house for use in the study. The experiment is to be conducted in a laboratory where 10 tiger shrimps are placed 
randomly into each of 12 similar tanks in a controlled environment. The biologist is planning to use 3 different 
growth-enhancing nutrients (A, B, and C) and two different salinity levels (ow and high). 

(a) List the treatments that the biologist plans to use in this experiment. 
{ 





(b) Using the treatments listed in part (a), describe a completely randomized design that will allow the biologist 
to compare the shrimps’ growth after 3 weeks. 


Asa ayn eaty tink a numb fem |e  & Duk vat envy 
orttymdls bo cay tok, hen, fr eo bk rah nw dig tut 
Ussinn The aypyr priake Munabeved Vorb finn part (al) be tho 
bu, Ra apn £ & rahul Aids aes ehvewdey 
Seon atgiyneh ture, “Vig design Honshormpoy asses Weubrends 

b buks, why ener vadbnach being nasigneal to tre tome, 


GO ON TO THE NEXT PAGE. 
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(c) Give one statistical advantage to having ay tiger sigs in the experiment. Explain why this is an 
advantage. 


Sime blyer wih ¥ le in Baty ono teystlis Yoon 
Aimy hay oe kes ub oy of Ader am wt ave, 
thle to veAue Ye viens cgfvt snr 7 sane Voig wth Phan pedaty 
varabilry Iwy rendement et ates tal a a cag a 





(d) Give one statistical disadvantage to having only tiger shrimps i in the experiment. Explain why this is a 
disadvantage. 


Sine wh we leg baer fiir, mM Meg nif generale Vet 
Veinlhs of dur Yhudy so eg ames Lait 
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5. A biologist is interested in studying the effect of growth-enhancing nutrients and different salinity (salt) levels in. 
water on the growth of shrimps. The biologist has ordered a large shipment of young tiger shrimps from a supply 
house for use in the study. The experiment is to be conducted in-a laboratory where 10 tiger shrimps are placed 
randomly into each of 12 similar tanks in a controlled environment. The biologist is planning to use 3 different 
growth-enhancing nutrients (A, B, and C) and two different salinity levels (low and high). 

(a) List the treatments that the biologist plans to use in this experiment. . / . . 


vse, A, low) (A; high) (6, low) (6, htph) (C, low) (C, hgh) 


(b) Using the treatments listed in part (a), describe a completely randomized design that will allow the biologist 
to compare the shrimps’ growth after 3 weeks. 
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GO ON TO THE NEXT PAGE. 
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(c) Give one statistical advantage to having only tiger shrimps in the experiment. Explain why this is an 
| Pets \ 
ove sir’! ler te otter Noe 


advantage. 
hecause tiger shrimp are ™ | 
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'. (d) Give one statistical disadvantage to having only tiger shrimps in the experiment. Explain why this is a 
disadvantage. . 
Tiger gh rimp mY aber fromm other tq pes of 3h OY, 
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5. A biologist is interested in studying the effect of growth-enhancing nutrients and different salinity (salt) levels in 
water on the growth of shrimps. The biologist has ordered a large shipment of young tiger shrimps from a supply 
house for use in the study. The experiment is to be conducted in a laboratory where 10 tiger shrimps are placed 
-randomly into each of 12 similar tanks in a controlled environment. The biologist is planning to use 3 different 
growth-enhancing nutrients (A, B, and C) and two different salinity levels (low and high). 


(a)_List the treatments that the biologist plans to use in this experiment. 
* Vikonks As | toto GAMASSy, 
“ORC oak Aah Nig SAAT 
DOLE B/S GAADACY 
* NWOXcsevrk BS | RRQ. BASS 
8 GRE Seve GC | LOLS GeO SY 
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(b) Using the treatments listed in part (a), describe a completely randomized design that will allow the biologist 
to compare the shrimps’ growth after 3 weeks. 
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(c) Give one statistical advantage to having only tiger shrimps in the experiment. Explain why this is an 
advantage. 
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(d) Give one statistical disadvantage to having only tiger shrimps in the experiment. Explain why this is a 
disadvantage. ’ ; 
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Question 5 
Overview 


The primary goals of this question were to evaluate a student’s ability to: (1) identify the treatments in a 
biological experiment; (2) present a completely randomized design to address the research question of interest; (3) 
describe the benefit of limiting sources of variability; and (4) describe the limitations to the scope of inference for 
the biologist. 


Sample: 5A 
Score: 4 


In part (a) a table is used to clearly present all six treatments. The treatment numbers used in part (a) are referred to in 
part (b) when a die is rolled to assign treatments to tanks randomly. The process of the random assignment is clearly 
described, and care has been taken to ensure that exactly two tanks are assigned to each treatment. In part (c) the 
essay states that by using only tiger shrimp, the variability among shrimp is less than would be present if all shrimp 
were included in the study. The advantage of reduced variation is nicely given as “allowing us to determine more 
clearly the effectiveness of each treatment.” The disadvantage of having only tiger shrimp and why it is a 
disadvantage is succinctly stated in part (d): “we may not generalize the results of our study to any other types of 
shrimp, as they could respond differently to the treatments.” Strong communication is present in each part. This essay 
earned a score of 4. 


Sample: 5B 
Score: 3 


Ordered pairs are used in part (a) to present the six treatment combinations for this experiment. In part (b) treatments 
are randomly assigned to tanks using a die. The student explicitly states that “he should roll again until he rolls a 
number of a treatment which has not already been assigned twice,” ensuring that each treatment is assigned to 
exactly two tanks. Although the response variable is not specifically stated as being the change in “size/weight” 
during the three weeks of the study, it is clearly indicated that measurements are to be made both at the study’s 
beginning and end. In part (c) a reduction in variability is clearly presented as the advantage of having only tiger 
shrimp. The “smaller standard error” is a restatement of this reduced variation. The student does not discuss why the 
smaller variability is an advantage. In part (d) the disadvantage of a limited scope of inference is identified by noting 
the inability to generalize the study’s conclusions to all types of shrimp. The fact that different species of shrimp may 
respond differently to the treatments is not given. This essay earned a score of 3. 


Sample: 5C 
Score: 2 


The treatment combinations are listed in part (a). The shrimp are randomly assigned to tanks in part (b), and this 
was considered to be extraneous information. Treatments are not randomly assigned to tanks, and this random 
assignment of treatments to experimental units (tanks) is the critical randomization for this study. Although the 
student begins to describe the advantage of reduced variability in part (c), this is said to “decrease the effect of 
lurking variables.” The use of lurking variable in this context is an inappropriate use of statistical terminology. 
“More precise conclusions” is not a sufficient explanation of why there is an advantage to using only tiger shrimp. 
In part (d) the student succinctly describes a limited scope of inference when using only tiger shrimp and explains 
that it is a disadvantage because “different kinds of shrimp may be effected [sic] differently.” This essay earned a 
score of 2. 
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